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CHAPTER  I 

CONTINUOUS  FUNCTIONS 


A.  Introduction 

Spatial  filtering  is  a  method  by  which  a  particular  object  or  set 
of  objects  may  be  highlighted  so  that  detection  is  improved  with  a 
minimum  loss  of  information.  When  a  signal  is  applied  to  a  device 
which  changes  the  characteristics  of  this  input  signal^  a  filtering 
process  has  been  performed.  Spatial  filtering  thus  implies  that  a 
fieldis  processed  to  create  a  new  field.  The  desired  relationship 
between  the  new  and  the  original  fields  specifies  the  nature  of  the 
filtering  to  be  accomplished. 

There  is  a  close  analogy  between  linear  spatial  filtering  and 
linear  temporal  filtering;  however,  many  of  the  restrictions  of 
temporal  filtering  do  not  apply  to  spatial  filtering,  such  as: 

1.  The  output  signal  in  a  time  filtering  circuit  cannot  appear 
until  the  input  has  appeared.  No  such  limitation  applies  to  spatial 
filtering. 

2.  Spatial  filtering  techniques  may  be  applied  to  any  number 
of  dimensions. 

It  is  thus  apparent  that  spatial  filtering  is  inherently  more  flexible 
than  time  filtering. 


1 


Inipulse  Response 


ao(t)  ^ 

A 

h(t). 

r(t)J 

A 

A 

A 

Fig.  1.  Temporal  filter. 


Figure  1  represents  a  temporal  filter  in  which  time  is  the  single 
independent  variable*  ^^(t)  represents  a  unit  impulse  and  h(t)  is  the 
characteristic  time  response  to  a  unit  impulse*  If  the  filter  A  is  linear 
and  stable  I  superposition  principles  may  be  applied  and  the  relation¬ 
ship  between  an  arbitrary  input  or  reference  signal  r(t)  and  the  filtered 

output  signal  c(t)  can  be  characterized  by  a  superposition  integral: 

+  00 

(1)  c(t)  =  y  r  (t)  h  (t-r)  d^ 

-  C» 

It  can  be  shown  that  the  Laplace  transform  of  r(t)  and  c(t)«  designated 
as  R(S)  and  C(S)  respectively,  are  related  by  an  equation  of  the  form: 

(2)  C(S)  =  H  (S)  R  (S) 

H(S)  is  normally  referred  to  as  the  transfer  function  of  the  filter  and  is 
the  Laplace  transform  of  h(t).  Thus  by  means  of  the  convolution 
integral  in  Equation  (1),  the  output  can  be  determined  in  real  time  by 
using  time  functions  rather  than  frequency  functions* 
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In  a  more  general  view>  filtering  may  be  considered  for  a  source 
signal  with  more  than  one  independent  variable,  as  for  example,  x  and 
y  space  coordinates*  Such  a  filtering  device  may  be  a  lens  or  similar 
optical  device  in  which  the  spatial  features  of  the  object,  such  as  the 
radiance,  determine  the  output  image*  As  stated  previously,  spatial 
filtering  techniques  may  be  applied  to  three  or  more  dimensions,*  how¬ 
ever,  the  concepts  developed  here  will  be  limited  to  two  dimensional 
signals  as  a  matter  of  convenience* 

Let  r  and  c  be  considered  now  as  functions  of  x  and  y  , 
where  r  is  again  the  reference  or  input  signal  and  c  is  the  output  or 
resultanf  image*  The  convolution  or  superposidon  integral  for  a  filter 
which  is  linear  and  independent  of  x  and  y  is  given  by: 


(3) 


c(x, y) 


+  00  +00 

r  (x',  y^)  h  (x  -  x^,  y  -  y^)dxMy' 

*00  y^=  -00 


h(x,  y)  is  the  spatial  impulse  response  of  the  filter*  Note  that  the 
integrals  rauige  from  -oo  to  +«>. 

C*  Frequency  Response 

The  frequency  response  of  continuous  f\inctions  may  be  deter¬ 
mined  by  means  of  either  the  Fourier  transform  or  the  Laplace  trans¬ 
form^  It  is  usually  more  advantageous  to  use  the  Fourier  transform  in 
a  general  case  because  the  range  of  the  integrals  includes  the  negative 
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region  as  well  as  the  positive  region..  The  Fourier  transform  for  the 
temporal  case  is  defined  as  r 

+  00 

(4)  F(jw)  =  y  f(t) 

-  00 


The  Fourier  transform  of  r(x, y)^  c(  Xiy)^  and  the  impulse  response 
h(x,  y)  can  be  written: 


(5) 


.  jwy)  =  R(jwx  »  jwy)H(ju>^  ,  jwy) 


Here  and  u>^  are  termed  spatial  frequencies*.  The  transforms  are 

determined  from  Equation  (4))  as  for  example: 

+  00  +00 

(6)  H  (ju.^  ,  jwy)  =  ^  J  h  (x.y)  dx  dy 

X  =  -00  y  =  «oo 

Because  of  the  two-sided  nature  of  the  transforms »  initial  conditions 
are  not  considered* 

The  inverse  transform  of  C(  ju)^^  ,  jwy)  is  given  by: 


(7) 


c(^>y)  =  -7^  y  ^  C(jujx  .  jwy) 


The  problems  of  determining  either  the  direct  or  inverse  transforms 
are  greatly  simplified  if  the  variable  r  and  h  can  be  written  in 
product  form 

(8)  r(x,y)  =  r^(x)  r^(y) 


4 


(9)  h(3c,y)  »  h^(x)  hy(y) 

or  as  sums  of  products 


(10) 


(U) 


'nx(*)  ^myCy) 


n  m 


H^.Y)  =  ^  l^ny^y) 


IX  m 


The  transform  of  Equation  (9)  for  example  is  then  given  by 


(12) 


ll(Mc  »  j<^) 


•+  «0 

00 


(x)  dx 


■+« 

y  hy(y)e'’ 


j“y^d, 


JL-  00 


and  the  transform  of  c  becomes  simply 

(13)  C(jwj^^  juy)  =  Fi  (ju^)  F2  (jWy) 

where  Fi  is  the  product  of  the  transforms  of  r^(x)  and  h3^(x)  and  F2  is 
the  product  of  the  transforms  of  ry(y)  and  hy{y)*  Unfortunately, 
separation  of  the  fxxnctions  is  not  always  possible^  Transforms  such  as 
Equation  (IZ)  can  be  foxmd  in  the  conventional  transform  tables  and  are 
generally  double -sided  transforms. 

Spot  Size 

A  spot  can  be  considered  as  a  continuous  function  of  x  and  y  * 
An  electron  beam  Atriking  the  face  of  a  cathode  ray  tube  is  an  example 
of  point  sources  acting  on  a  medium  and  the  response  can  be  described 
in  x,  y  coordinates  as  ; 


(14) 


h(^.y)  »  e 


-k(x*  +  y *) 
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In  order  to  determine  the  spatial  frequency  response  of  the  tubei 
jwy^  must  be  determined. 


(15) 


H(K,j»y)=  ^  *  y‘ >  .-■i<V+‘VV»axdy 

-  00 


This  can  be  separated  as 
+  00 

(16)  H(ju»x.  jLOy)  =  y 


+  00 

C 

l"  -(Iuc*+juxx) 

J  " 

J  '  ** 

00 

V 

.-00 

"jWyYdy 


Now,  it  is  known  from  the  Gaussian  distribution  function  that  the 
following  relationship  exists : 

1 


+« 


(17) 


vTiT 


2o-^  1 

e  dx  =  1 


Eqixation  (17)  can  be  used  to  evaluate  Equation  (16)  if  we  let  Z<r^  s  1 
Then  a  =  JI/I 


and 

(18) 

or 

(19) 


4-^ 


1 

- -  fe'"'. 

'  1  \  J 


dx  =  1 


~1T 


+  00 

y  e'^'^dx  =  >nr 


+00 


-(kx^  +  jw„x) 

k  A. 


dx 


Consider  the  bracket  term 
then  dx  =  dz  and 

kx^  +  jw  X  =  ka^  +  2  a  z  k  +  kz^  +  jw  a  +  jw. 


in  (16) «  Let  x  s  a  +  z. 
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Let  2  a  k  2  +  jw  z  =  0,  or  a  =  -  j  — 

2 

U)  * 

Then  kx*  +  jw  x  =  kz*  +  — ~ 

^  4k 

The  bracket  term  then  becomes 
+  00 

-(kz*  +-7^) 
e  4k  dz  =  e 


{20) 


U) 


2 

X 

4k 


T  « 

I 


kz^ 
e  dz 


Let 


(21) 


k  =  r^  and  kz*  =  r^  z^  »  i  then  dz  - - 

r 

2  ,  2 


^  I 


+  00 


“m2  ^  Jtt  e 
e  dm  = - 


X 

4r2 


or 


(22) 


X 

i[r 


>nr 


The  saune  operation  performed  on  the  y  terms  yields 

U)  2 


+  00 


(^3) 


'  -(ky*  +jw  y) 

t  e  ^  dy  =  ^ - 


4k 


Thus 


(24) 


H  (  jWj^,  jWy)  = 


TT  e 


(  -X  +  -y'  ) 

4k 
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CHAPTER  11 
DISCRETE  CASE 


I 

I 


I 


In  any  filtering  process,  the  characteristic  response  of  the 
filter  to  a  unit  impulse  is  used  to  determine  the  output  for  an  arbitrary 
input  signal.  In  a  discrete  filter,  this  characteristic  response  is 
defined  as  a  matrix  A  =  *  Since  p  and  q  can  have  both  positive 

and  negative  values »  conventional  notation  cannot  be  used  in  which  the 
upper  left  matrix  element  is  designated  as  ,  It  is  therefore  neces¬ 
sary  to  indicate  the  values  of  p  and  q  for  at  least  one  position  in  the 
matrix.  In  the  convention  used  here,  each  matrix  position  is  divided 
diagonally,  with  the  position  notation  in  the  upper  left  segment  and  the 
element  value  in  the  lower  right  segment.  Thus  a  typical  A  matrix 
could  be  that  shown  in  Figure  Z. 


/+! 

oV 

Az 

/  2 

Fig.  Z.  A  Matrix  for  spatial  filtering. 


In  Section  I,  the  case  of  continuous  functions  was  treated  wherein 
the  object,  filter,  and  resulting  image  were  each  continuous  in  x  and 
y  .  The  spatial  filtering  techniques  described  in  this  section  will  make 
use  of  the  discrete  A  matrix  as  a  filter;  however  the  object  and  image 
may  be  either  discrete  or  continuous. 
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Before  discussing  the  filtering  process  itself*  it  is  worthy  to  note 


some  of  the  characteristics  of  this  A  matrix* 

1«  If  the  ^  ^  a^  =  0,  there  is  a  zero  average  value  for  the 

p  q 


output  when  this  matrix  is  used  as  a  filter*  In  other  words*  the  dc 
level  is  not  passed  in  such  a  filter. 

2.  If  the  ^  ^  a^  jfc  0,  the  dc  level  is  passed  and  the  image  will 


p  q 


have  an  average  value  taken  over  all  cells  which  is  not  equal  to  zero* 

3*  Certain  configurations  of  values  in  the  A  matrix  permit 
expressing  the  matrix  as  A  =  MN ,  where  M  indicates  a  column 
matrix  and  N  indicates  a  row  matrix*  ( The  proof  of  this  is  in  Section 
II  B* )  If  this  is  possible,  the  terms  can  be  treated  separately  as 
functions  of  x  only  and  functions  of  y  only*  As  a  matter  of  con¬ 
venience,  the  discussions  which  follow  will  be  restricted  to  this  type 
of  matrix. 

An  example  of  3  above  is  shown  in  Figure  3. 


(a)  A  Matrix  As  A  Column  (b)  Resultant  A  Matrix 
And  Row  Matrix 

Fig.  3.  Factoring  an  A  Matrix. 
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A,  Discrete  A  Matrix^  Continuous  Object  and  Image 


■ 

■ 

■ 

■ 

BS 

■: 

■ 

■ 

■1 

A  Matrix 


Fig.  4.  Filtering  a  continuous  object. 


An  individual  scene  can  be  described  connpletely  as  far  as  the 
spatial  distribution  of  radiance  is  concerned.  The  two  dimensional 
function  R(x,  y),  where  R  is  a  radiance,  gives  all  the  available 
information.  The  information  is  usually  collected  by  some  type  of 
sensor  which  is  limited  in  the  resolution  of  surface  detail.  This 
characteristic  of  the  sensor  will  be  defined  here  as  the  cell  size  of  the 
sensor.  The  cell  dimensions  will  be  defined  as  the  minimum  size  of 
cell  such  that  two  identical  objects,  each  located  in  a  similar  position 
in  adjacent  cells,  will  always  be  separated  or  resolved  by  the  sensor. 

In  the  case  of  a  ground-based  radar,  the  cell  size  is  given  by  ct/2  in 
range  and  rA<j)  in  azimuth,  where  c  is  the  velocity  of  light,  t  is  the 
pulse  width,  r  is  the  range,  and  A<j)  is  the  beamwidth  of  the  antenna  in 
azimuth.  In  the  case  of  the  image  orthicon  or  similar  optical  trans¬ 
ducers,  the  cell  size  must  be  defined  in  terms  of  the  size  of  the  electron 
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used  to  scan  the  image  projected  upon  the  sensitized  surface 
within  the  pickup  tube* 

Figure  4  depicts  a  continuous  object  which  is  to  be  filtered  by  the 
discrete  A  matrix*  This  continuous  object,  0(x, y),  may  be  pictured 
as  an  aerial  view  of  terrain  in  which  contours  are  functions  of  x  and 
y;  or  intensity  levels  in  an  infrared  photograph  would  yield  continuous 
functions  of  x  and  y*  The  resultant  image  is  labeled  I(x,y)* 

In  order  to  perform  spatial  filtering  on  this  continuous  object, 
0(x,  y),  two  approaches  may  be  considered* 

1.  The  object  may  be  sampled  to  yield  discrete  values  for  the 
X,  y  positions*  This  quantized  object  may  then  be  operated  upon  by 
the  A  matrix  using  a  convolution  process  to  produce  a  discrete  image 
I(x,  y)*  This  convolution  process  is  discussed  in  Section  II  B.  By  use 
of  a  ^  type  filter  or  a  holding  circuit,  the  discrete  image  can  be 

X 

changed  to  a  continuous  function*  It  might  be  pointed  out  that  the  human 
eye  cad  also  perform  this  discrete -to- continuous  operation  as  evidenced 
by  a  photograph  in  a  newspaper,  which  is  made  up  of  a  large  number 
of  closely  spaced  dots,  appearing  to  be  of  a  continuous  nature  when 
viewed  from  reading  distance. 

Z*  The  A  matrix  may  be  transformed  into  a  continuous  function 
by  describing  it  as  a  series  of  step  functions*  The  filtering  process  is 
then  the  same  as  in  Section  I  where  the  object  and  filter  were 


11 


continuous.  As  an  example  of  this  process,  consider  the  A  matrix  in 
Figure  3,  This  can  be  represented  as  : 


h(x)  or  h(y) ^ 

1 

-1 

-3  -2 

1 

1 

2 

1  2  3 

'  1  > 

1  * 

1 

‘2 
—  1 

1  X  or  y 

Fig.  5.  The  A  Matrix  described  as  step  functions. 


The  equations  may  be  written  for  Figure  5  as ; 


(Z5)  = 


Collecting  terms 


(26)  H  (ju;„)  =  - 


gjwx  _ 

j. 

e  ^  -  e 

ju^x 

2 

(27)  H  (joo^)  =  3 


Sin 


sin  3  LJx 


H^(jwy)  is  obtained  here  by  substituting  in  Equation  (Z7)  for 
since  the  matrix  is  symmetrical  about  the  center  cell*  This  expression 
illustrates  how  the  x  and  y  spatial  frequencies  are  filtered.  It  corre¬ 
sponds  roughly  to  a  bandpass  filter  except  that  it  introduces  no  phase 
shift.  The  function  is  sketched  in  Figure  6. 
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Fig.  6.  Frequency  response  of  the  A  Matrix 
as  a  function  of  or 


To  determine  l(Xfy)  when  using  this  filter,  the  Fourier  trajis- 
form  of  the  object,  O(jt0x  ,  jiOy) ,  is  determined  as  described  in  Section 

!• 

+  00 

(28)  0(jwx  ,  jwy)  “  y  y  0(x,y)  e  dy 


(29)  j“y^  =  H(jwx  .  jWy)  0(ju)jj  ,  juy.) 

+  00 

(30)  I(x,y)  = — i —  C  r  I(ji*)j^  .  jw  )  dw 

(Zir)^  J  > 


Before  method  1  above  may  be  employed,  the  continuous  object 
must  first  be  sampled^  It  must  be  kept  in  mind  that  the  sampling 
frequency  must  be  at  least  twice  the  highest  frequency  of  the  input 
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signal  in  order  to  recover  the  full  information  content  with  a  linear 
device  which  can  separate  only  on  the  basis  of  differences  in  the 
frequency  spectrum.  In  a  spatial  object,  the  variations  in  the  x,y 
plane  correspond  to  amplitude  variations  in  a  time  signal,  which  is 
one  dimensional. 


rj) _ X  rs(t) 


Fig.  7.  A  simple  sampler. 

Consider  a  simple  time  sampler  as  shown  in  Figure  7. 

Figure  8  depicts  sampling  as  modulation  of  a  pulse  train  where  the 
amplitude  of  the  sampler  output  is  derived  from  the  value  of  the  input 
signal  at  any  given  time.  An  impulse  occurring  at  t  =  nT  would  have 
a  Laplace  transform  of 

(31)  L[uo(t  -  nT)]  =  e-^'TS. 


|i(t) 


A  rs(t) 


I  I  1  I  I  It. 


t  2t  3t  4t  5t 
(b)  Pulse  Train 


^  t  ^ 


t  2t  3t  j 
(c)  Sampler  Output 


Fig.  8.  Sampling  considered  as  modulation 
of  pulse  train. 
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[ 

[ 

[ 


This  is  seen  to  be  a  shifting  function «  or  delay*  Thus  the  sampler 

— nTS 

output  at  t  3  nT  wotild  be  r(nT)e  •  The  shifting  function  form  is 
used  in  the  Z  trctnsform  by  defining 
(32)  Z  = 

To  sample  the  spatial  objecti  the  same  sampling  method  may  be 
used  except  that  two  dimensional  shifting  is  required*  In  this  case«  the 
shifting  function  Z  is  defined  as 


S„  AY 
Zy  -  e  y 


where  AX  auid  AY  are  determined  by  the  sensor  resolution. 

Now  the  image^  ^  ,  which  res\ilts  from  a  sampled  object, 
Om  xi»  ^  discrete  filter  can  be  expressed  as 


(34) 


I 

m,  n 


~  ^  ^  ®m-k,n-p 
k  p 


where  a^^  and  a^  may  be  considered  as  weighting  fvinctions  derived 
from  the  impulse  response  of  the  A  matrix  filter*.  Only  symmetrical 


discrete  filters  are  considered  in  the  derivations  here  and  the 


weighting  functions  can  therefore  be  treated  independently*  A  spatial 
filter  will  usuatlly  be  symmetrical  to  avoid  xmdesired  distortion  of  the 
object*  It  must  be  remembered  that  a  filter  is  designed  to  produce  a 
desired  output  from  a  given  input. 
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Z  transforms  may  be  used  to  describe  the  shifting  and  the  trans¬ 


form  of  the  object  becomes 


(35) 


-m  -n 
Z  Z 

X  y 


m  n 


The  transform  of  the  image  is 


(36) 


m  n 


The  weighting  functions  of  the  filter  become 


(37) 


A^( Z^) 


-m 

m 


(38) 


Ay(z^) 


Then 

(39) 


Gl'  -  A,(  Z*)Ay(  Zy)G„(  Z^.  Zy) 


As  an  example  of  this  type  of  transform,  consider  the  A  Matrix 
used  previously  in  Figure  3*  The  Z  transform  would  be 


(40) 


Ax(  2*1  = 


i  2x‘  +1  2° 


-  T  Z 


+1 


Ay(  Zy)  would  be  the  same  except  for  subscripts. 


(41) 


(Zx-1)‘ 


X 


16 


i 

r 


I 


(4Z) 


(43) 


Ay(  Zy)  «  -  i 


(  Zy  -  D* 


A^(Z^)Ay{Zy) 


D*  (Zy-1)* 


z 

y 


I 

[ 

[ 

[ 

[ 

[ 

[ 

i. 
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B.  Discrete  A  Matrix^  Discrete  Object  and  Image 
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n 
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n 

Sensor 

n 

n 

IS 
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n 

ISI 
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■ 

D 

D 

IS 

0 

n 
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■ 

D 

n 

IS 

n 

n 

Filter 

D 
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IS 

a 

n 

A  Matrix 

Photograph  Oi$crete  Object  Discrete  Image 

X  Matrix  Y  Matrix 

Fig.  9.  Filtering  a  discrete  object. 


Consider  a  system  such  as  that  shown  in  Figure  9  where  an 
object,  such  as  a  photograph,  is  scanned  by  a  sensor.  The  output 
of  the  sensor  is  sampled  as  described  in  the  previous  section  to  yield 
discrete  values  for  each  cell  in  the  storage  location,  which  shall  be 
called  the  X  Matrix.  Each  position  of  this  X  Matrix  then  corresponds 
to  an  X,  y  position  in  the  original  photograph  and  the  value  of  the  cell 
corresponds  to  the  amplitude  of  the  photograph  (for  example,  the 
intensity)  at  that  position.  It  can  be  expected  that  noise  will  be  intro¬ 
duced  along  with  the  signal  so  that  ideal  values  as  shown  in  the 
discrete  object  will  not  be  realized.  Filtering  by  a  discrete  A  Matrix 
filter  will  produce  a  discrete  image,  which  shall  be  designated  the 
Y  Matrix, 

The  system  in  Figure  9  could  be  reduced  by  performing  the 
desired  filtering  as  the  information  is  being  stored  in  the  X  Matrix, 
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but  it  seems  more  convenient  to  explain  the  filtering  action  in  the 
system  as  shown*  Thus,  the  system  now  consists  of  a  discrete  object, 
filter,  and  image* 

As  mentioned  before,  the  characteristics  of  the  spatial  filter  are 
based  on  the  desired  final  product  -  the  image*  Functions  which  can  be 
performed  spatially  include  averaging,  differentiation,  and  integration. 
Use  is  made  of  averaging  to  remove  fine  detail  of  a  field  but  extended 
structure  is  retained*  Differentiation  can  be  used  to  retain  sharp 
boundaries  while  the  background  is  removed. 

The  Y  Matrix  will  have  the  same  number  of  rows  and  columns 
as  the  X  Matrix  but  it  will  contain  the  desired  features  of  the  X Matrix 
with  the  redundancies  and  undesired  information  removed.  The  informr 
ation  stored  in  cell  y^j  of  the  Y  Matrix  may  be  expressed  by 

(44) 

p  q 

It  can  be  seen  that  this  requires  a  shifting  process*  For  this  purpose 
a  shifting  matrix  may  be  used  by  defining 

1.  i  =  j  -  g 
0,  otherwise 

where  g  is  a  constant  integer  which  can  be  either  positive  or  negative. 
The  shifting  direction  is  determined  by  the  sign  of  g  and  whether 


Sg  = 


ij 
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occurs  before  or  after  the  matrix  to  be  shifted.  As  an  example: 

B=  S  C 
g 


or 


J 


By  the  definition  of  s ,  the  only  term  which  has  a  value  is  the  one  for 
which  j  =  i  +  g  ;  thus 


'^ik  "  +  gi  k 


When 


B  =  CSg. 


‘^ki  ®ij  =  ‘'kj  -  g 


With  g  a  positive  integer,  it  can  be  seen  that  when  the  shifting  matrix 
appears  first,  the  resultant  matrix  is  identical  to  the  original  matrix 
except  that  all  elements  have  been  shifted  g  rows  with  g  rows  of 
zeros  at  the  bottom  of  the  resultant  matrix.  When  appears  after  the 
original  matrix,  the  resultant  matrix  elements  have  all  been  shifted  g 
columns  to  the  right  with  g  columns  of  zeros  on  the  left.  is  the 
identity  matrix. 

To  demonstrate  this  shifting  operation,  take  the  case  for  negative 
shifting  by  letting  g  -1« 

B  =  S_^C  = 


20 


0 

0 

0 

0 
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12 

Note  that  C  has  been  shifted  down  one  row  to  form  B* 

B  =  CS_j  bj^j  »  cjj j  +  1 


12  3  4 

0  0  0  0 

2  3  4  0 

B  = 

5  6  7  8 

9  10  U  12 

10  0  0 
0  10  0 

fi 

6  7  8  9" 

10  U  12  0 

13  14  15  16 

0  0  10 

14  15  16  0 

Note  that  C  has  shifted  left  one  colhmn  to  form  B« 

ThuSf  column  and  row  shifting  of  the  X  Matrix  can  be  performed 
by  the  process 


SpXS 


q 


which  shifts  the  original  X  Matrix  up  p  rows  and  q  columns  right 
(p  and  q  positive  integers)*  Equation  (44)  can  therefore  be  written  in 
matrix  form  as 


(45) 

p  q 

As  stated  previously «  and  shown  in  Figure  certain  arrange¬ 
ments  of  the  A  matrix  elements  lend  themselves  to  column  and  row 
factoring*  If  such  is  the  case,  so  that  A  »  MN,  where  M  «  ^ 

column  matrix  and  N  «  n.  .  is  a  row  matrix,  Eqiiation  (45)  can  be 

q 

expressed  in  the  form 
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(46) 


p  q 


m  S_  X  S  „  n 

p  p  -q  q 


since  a  s  m^n  .  The  summations  are  now  independent  of  the  matrix 

pq  P  q 


multiplications  so 


=  y  mS  x  \  S  „n, 

^  p  p  -q  « 


or 

(47) 

when 


>"pSp 


Y  «  A”  X 


and 


A‘ 


It  is  usually  desirable  to  find  a  single  A  matrix  which  performs  the 
same  function  as  the  sequential  application  of  and  A*  «  This  can  be 
symbolized  by 


(48) 


A  =  A  ^  A' 


The  *  operation  must  satisfy  the  operations  for  an  X  =  matrix 


such  that 


pq 


1#  p  =  a;  q  =  b 
0,  otherwise 


AVhen  X  is  operated  on  with  A  only,  the  following  result  is  obtained; 


p  q 
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An  operation  on  X  with  and  A'  yields 

Va-ub-j  “  ^  X^c.d  *a-i+u+c,b-j 


+v  +d 


u  V 


c  d 


a°  at 

U,V  1-U,J-V 


U  V 


Therefore 


(49)  a..=^Va®  at 

IJ  ^  U,V  l-U,  J-V 

U  V 

It  is  thus  seen  that  for  A  =  A^  ^  A'l  the  ^  operation  is  a  two  di* 


mensional  convolution  operation. 

If  A^  and  A  are  both  factorable  into  one  row  and  one  column 
matrices »  so  that  A^  =  and  A*  =  M»NS  then  the  convolution  of 

A^  and  A<  may  be  expressed  as 


U  V 


Since  the  summations  are  independent 


t..  =  )  m®m>.  )  n®n».  =  m.  n. 

iJ  Z/  u  i-u^  n  j-v  1  j 


u 


where 


m. 


1.  =  >  m®  m.^  and  n.  «  >  n®  n\ 

1  ^  u  i-u  J  ^  V  j-v 

U  .  V 

The  resultant  A  matrix  can  therefore  be  expressed  as  A  »  MN  •  The 
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A  matrix  is  thus  factorable  when  A®  and  A»  are  factorable  and  the 
elements  a^  of  the  A  matrix  can  each  be  obtained  by  a  one- 
dimensional  convolution. 

Desired  information  can  be  stored  in  the  Y  matrix  of  Figure  9^ 
while  undesired  information  is  rejected,  by  selecting  a  specific  A 
matrix  to  perform  the  required  filtering.  It  was  shown  in  Figure  6 
that  filtering  comparable  to  a  bandpass  temporal  filter  could  be 
obtained  from  an  A  matrix  such  as  that  shown  in  Fig.  3.  A  low  pass 
filter  can  likewise  be  devised  which  will  perform  a  smoothing  (or 
averaging  )  function.  Consider  a  normalized  A  matrix  of  the  form 

2 

3 

I 

3 

i 

3 

(a) 

The  low  pass  characteristic  may  be  seen  from  its  continuous  form 
as  developed  in  Section  II  A,  pages  II,  12  and  13  . 


i 

3 


I 

3  . 


Factored  Form  Of  (b)  A  Matrix 
The  A  Matrix 

Fig.  10.  A  Matrix  for  spatial  smoothing. 
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[ 

[ 

[ 

I. 


Fig.  12.  Frequency  response  of  A  Matrix  as 
a  function  of  wx  or  Wy 

It  can  thus  be  seen  that  an  A  matrix  of  the  form  shown  in  Figure  10 
will  exhibit  low  pass  filter  characteristics* 

Gradient  information  can  also  be  obtained  by  the  form  of  the  A 
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matrix.  For  one --dimensional  spatial  differentiation^  consider  the 
cells  of  the  A  matrix  as  having  a  center-to-center  spacing  of  one  unit. 
To  store  gradient  information  in  the  Y  matrix,  it  is  necessary  that 


(52) 


X.  ,  ,  ,  -X,  . 


Au 

where  Au  is  the  spacing  between  columns  (and  equal  to  one) .  If 
Av  =  1  is  the  spacing  between  rows,  two  dimensional  gradient  inform¬ 
ation  may  be  obtained  by 


J 


(x,  .  ,  1  "  (x,  .  .  -  X.  .  ) 


Au 


Av 


(53) 


J 


i,  j+1'*'  2^i  +1,  j 


Au  ' 


An  A  matrix  which  will  perform  the  operation  in  Equation  (52)  would 
be  as  shown  in  Figure  13  (a).  The  two-dimensional  form  in  accordance 
with  Equation  (53)  is  sho\vn  in  Figure  13  (b). 


0 

+1 

0 


+1 


0.( 


(a)  A  Matrix  For 
One*  dimensional 
Spatial  Differentiation. 


'V 

% 

(b)  A  Matrix  For 
Two-dimensional 
Spatial  Differentiation. 


Fig.  13.  A  Matrices  for  differentiation. 
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The  cells  values  correspond  to  the  coefficients  in  the  equations  and 
the  cell  positions  to  the  subscripts  (x^j  is  the  0,  0  position)  • 

Consider  the  advantage  of  using  a  one -dimensional  gradient  type 
filter  where  the  X  matrix  has  large  areas  of  redundancy.  For  example: 
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Example  of  one-dimensional  gradient  storage. 


A  row  through  the  centers  .of  the  X  and  Y  matrices  would  appear  as 
shown  in  Figure  15.  The  -1  in  .the  far  right  column  of  the  Y  matrix  is 
created  by  the  boundary  of  the  matrix  and  in  a. large  field  it  would  not 
be  considered.  It  can  be  seen  that  information  is  stored  in  the  Y  matrix 
only  when  there  is  a  chatnge  in  levels  between  adjacent  cells  in  the  X 
nxatrix.  Hence  redundancies,  are  eliminated. 

Further  examples  of  spatial  filtering  with  a  discrete  system  are 
shown  in  the  following  section. 
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X  Matrix 


+1 

0 


Y  Matrix 

Fig.  15.  Result  of  spatial  differentiation. 

C •  General  Examples 

The  application  of  the  A  matrix  in  Figure  16  to  an  X  matrix, 
which  has  a  constant  background  level,  is  shown  for  two  cases  in 
the  following  figures*  In  Figure  17,  combinations  of  single  elements 
which  differ  from  the  background  are  to  be  filtered*  In  Figure  Zl, 
vertical,  horizontal,  and  diagonal  lines  are  shown  against  the  constant 
background*  The  shaded  X  matrices  in  Figures  17  and  Zl  may  be 
considered  as  ’'pictures"  containing  discrete  objects  or  lines  against  a 
constant  background*  These  "pictures"  are  given  a  relative  intensity 
value  for  each  cell,  just  as  would  be  done  in  a  sampler  (Figures  19 
and  Z3)  •  The  filtering  action  of  the  A  matrix  is  shown  in  both  "picture" 
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and  ''numerical  intensity"  form  in  the  Y  matrices  of  Figures  18,  20, 

22,  and  24*  In  the  "pictures",  the  highest  intensity  is  considered  as 
white  and  the  lowest  intensity  as  black*  Thus,  the  Y  matrix  "pictures" 
are  actually  relative  intensities,  with  white  and  black  as  the  bounds* 
The  "numerical  intensity"  figures  for  the  Y  matrices  have  been  derived 
from  the  relationship  discussed  in  Section  n  B  and  repeated  here  for 
reference 

^ij  +  P*  j  +  q 

The  periphery  values  in  the  Y  matrices  should  be  disregarded  as  they 
have  little  meaning*  In  the  calculation  of  y^j,  the  value  of  zero  was 
taken  for  any  element  outside  of  the  array*  For  a  picture  of  large  . 
extent,  these  boundaries  would  not  be  so  evident. 
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Fig.  17.  X  Matrix. 
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Fig.  19.  Numerical  intenaity  X  Matrix  for  Fig.  17. 
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Fig.  20.  Numerical  inteneity  Y  Matrix  for  Fig.  18. 
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Fig.  21.  X  Matrix. 
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Fig.  23.  Numerical  intensity  X  Matrix  for  Fig.  21. 
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Fig.  24.  Numerical  intensity  Y  Xiatrix  for  Fig.  22. 


CHAPTER  III 

REALIZATION  OF  SPATIAL  FILTERING 


.  At  the  present  time^  all  sensors  which  detect  spatial-type 
information  must  scan  the  area  of  interest  in  some  prescribed  manner 
and  the  resulting  information  appears  as  a  signal  at  a  set  of  terminals 
with  a  single  independent  variable ^  namely  time.  If  the  original  field 
varies  as  a  function  of  time;  each  frame  produced  in  the  scanning 
process  is  essentially  a  single  sample  (samples  in  time)  of  the  field. 
Because  the  area  scanned  usually  has  two  spatial  coordinates^  it  is 
necessary  to  establish  a  raster  which  defines  the  path  followed  by  the 
sensor  in  scanning  the  area.  This  faster  indicates  the  manner  in 
which  the  area  is  sampled  spatially.  In  spatial  filterings  it  will 
generally  be  necessary  tp  store  at  least  a  section  of  the  image.  This 
can  be  accomplished  dynamically  by  delay  lines  of  various  types,  or 
by  static  means  of  storage  such  as  magnetic  cores,  drums,  or  tapes. 

System 

1.  Mechanical  Scanning 

By  means  of  polarizing  devices,  the  intensity  of  incident  light 
can  be  varied.  Consider  the  form  that  an  A  filtering  matrix  assumes  - 
each  cell  has  a  discrete  value.  If  an  object  (picture)  has  different 
light  intensity  levels  corresponding  to  its  features  (for  example,  a 
television  picture  of  a  stationary  scene),  the  light  intensity  from  any 
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segment  can  be  varied  by  polaris&ation«  As  mentioned  previously,  a 
scanning  process  is  requited  for  spatial  filtering* 

A  lens  consisting  of  discrete  segments,  in  which  the  orientation 
of  the  polarizing  devices  is  varied  to  produce  the  relative  values 
desired  in  an  A  matrix,  could  be  used  to  scan  an  illuminated  picture* 

A  phototube  attached  to  the  lens  would  then  sum  the  output  from  the 
filtered  object  and  store  this  information  in  a  suitable  device  ( Y 
matrix) . 

A  simplified  form  of  this  system  is  shown  in  Figure  25.  The 
cross-hatched  areas  correspond  to  ^  ,  the  horizontal -lined  areas 
to  j  ,  and  the  clear  area  to  1  (no  attenuation)* 

By  scanning  the  entire  picture  and  storing  the  output  from  each 
position  on  which  the  filter  is  centered,  a  spatially-filtered  image  can 
be  realized. 

This  system  has  the  disadvantage  of  being  extremely  slow  as 
each  frame  must  be  mechanically  scanned  before  another  frame  can  be 
admitted  to  the  filtering  section. 

2.*  Electronic  Scanning 

Another  device  that  appears  to  have  operating  principles  which 
could  be  adapted  to  spatial  filtering  is  the  charactron  tube.  This  tube 
has  a  matrix  through  which  the  electron  beam  is  directed  to  select 
desired  characters  for  subsequent  positioning  on  the  face  of  the  tube* 
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Front  View 


(Q)  Desired  A 
Matrix 


(b)  Lens  System  In 
One  Position  For 
Fi  Itering 


Fig,  25,  Lens  system  for  spatial  filtering. 


Now  consider  a  modification  to  an  image  orthicon  camera  tube  in 
which  a  matrix  is  positioned  between  the  cathode  and  the  target*  This 
matrix  coxild  correspond  to  am  A  matrix  by  having  each  segment 
consist  of  a  certain  size  mesh*.  Now«  if  an  electron  beami  which  would 
completely  cover  the  matrix,  (consider  the  A  matrix  as  a  3  x  3 matrix 
for  this  case)  was  directed  through  the  matrix,  the  number  of  electrons 
going  through  each  segment  would  be  directly  proportional  to  the  mesh 
size*  After  passing  through  the  matrix,  the  electron  beam  would  then 
be  deflected  for  the  desired  raster  used  in  scanning  the  target.  The 
center  of  the  beam  would  correspond  to  the  a^^  position  of  the  A 
matrix  and  the  point  upon  which  it  was  directed  on  the  target  at  any 
instant  of  time  would  correspond  to  the  y position  of  the  Y  matrix* 
The  beam  would  thus  cover  9  normal  cells  on  the  target*  The  number 
of  electrons  in  the  return  beam  would  then  be  dependent  upon  the  A 
matrix  values  and  the  charge  distribution  on  the  target*  This  would 
provide  the  desired  multiplication  of  all  cells  adjacent  to  .  (the 
target  is  the  X  matrix)  by  the  proper  a^^  of  the  A  matrix*  The  sum-* 
ming  is  done  by  the  number  of  electrons  in  the  return  beam*  This 
would  provide  a  much  more  rapid  means  of  scaxming  a  target  than  the 
previous  device  consisting  of  a  photo-tube  and  polarized  lens* 
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CHAPTER  IV 

SPATIAL  FILTERING  WITH  FEEDBACK 


If  a  television  camera  is  placed  in  front  of  its  monitor  so  that 
the  field  of  the  camera  exactly  coincides  with  the  size  of  the  monitor 
screen,  an  x,y  position  of  the  monitor  then  corresponds  to  the  same 
X,  y  position  of  the  sensitized  material  in  the  camera*  For  example,  a 
spot  in  the  exact  center  of  the  monitor  screen  would  be  in  the  exact 
center  of  the  image  orthicon  photo -cathode*  Transmission  by  the 
camera  would  place  the  spot  in  the  same  original  position  on  the 
monitor* 

Now  if  the  camera  is  displaced  either  to  the  right  or  left,  a 
series  of  spots  will  be  shown  on  the  monitor  with  spacing  between 
the  spots  equal  to  the  camera  displacement*  This  may  be  shown  by  a 
top  view  of  the  camera  and  screen: 


Screen 

Point 

Source 


Camera 


1 

lAx 

L 

Point  ^ 
^  Source^^, 

L  ^ 

Ax 

i 

N 

-*AxU-  -*1ax1 

-1^ 

(a)  No  Displacement  (b)  Camera  Displaced  (c)Camera  Displaced 

To  The  Right  To  The  Left 


Fig.  Z6.  Top  view  of  camera  and  monitor  screen 
for  spatial  filtering  with  feedback. 
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This  system  is  shown  in  Figure  27  as  a  servo  diagram*  Laplace  trans¬ 
form  for  the  transfer  function  is  used. 


R(Sx) 


G(Sx) 


C(Sx) 


Fig.  27.  System  servo  diagram. 


When  the  camera  is  displaced  to  the  right  a  distance  AX«  the  spots 

are  displaced  to  the  left  by  an  amount  AX*  There  is  thus  a  shifting 
+AXS 

function  e  For  camera  displacement  to  the  left,  the  shifting 

-  AXS 

function  becomes  e  ^  .  The  closed  loop  transfer  function  becomes 


±  AXSx 

Ic  G 

1  - 


;S^  =  a  +  j  P 


Two-sided  Laplace  transforms  must  be  used  for  this  system  to  define 
a  for  each  direction.  In  time  systems,  instability  would  occur  when 


the  denominator  equals  zero.  If  such  were  the  case  here,  for  the 


positive  exponent 


+AX(a  +jP)  , 

a  _  * 


A  X  =  n2  n 

ft  .  n27r 


Since  the  shifting  is  to  the  left,  AX  can  be  considered  negative  and 
must  therefore  be  positive  for  convergence  of  the  Laplace  integral  • 
When  shifting  is  to  the  right  AX  is  positive  and  az  must  be  negative 
for  convergence.  Therefore,  the  region  of  convergence  in  the 
plane  is  a  2  $  0  ^  ai  . 

Actually  instability  is  not  a  problem  because  the  system  is 
boimded.  Intensity  of  the  spots  cannot  increase  beyond  the  percent 
modulation  of  the  video  signal  in  the  camera  for  a  pure  white  object. 


CHAPTER  V 

CONCLUSIONS  AND  RECOMMENDATIONS 

Spatial  filtering  is  a  process  which  may  be  utilized  to  highlight 
desired  features  in  a  field  of  view,  A  scanning  process,  which  is  a 
function  of  time,  is  required  to  process  the  field  and  store  the  infor¬ 
mation  in  suitable  form.  It  has  been  shown  in  Reference  1  that  a  time 
varying  signal  may  be  stored  in  a  matrix  of  transfluxors  by  signal 
steering  techniques.  Once  this  information  is  in  matrix  form,  the 
spatial  filtering  process  may  be  applied  to  eliminate  redundancies, 
smooth  fluctuations,  or  select  desirable  features  from  a  background. 

It  has  been  shown  that  time  filtering  procedures  using  Laplace 
or  Fourier  transforms  may  be  extended  to  include  more  than  one 
variable,  namely  space  coordinates.  The  restrictions  of  temporal 
filtering  may  be  overcome  with  spatial  filtering  because  the  space 
coordinates  may  range  over  all  values  from  plus  infinity  to  minus 
infinity. 

Spatial  filters  may  be  realized  by  means  of  lens  systems,  trans¬ 
fluxors,  digital  techniques,  and  other  systems.  Only  two  methods 
have  been  discussed  here,  but  it  is  possible  to  devise  such  filters  by 
any  means  which  can  multiply  and  sum  the  required  elements.  It  is 
believed  that  the  electronic  scanning  method  could  provide  an  ex¬ 
tremely  rapid  means  of  accomplishing  the  desired  filtering. 
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